Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	4177
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	514.1 KiB
Average record size in memory	126.0 B

Variable types

NUM	8
CAT	1

Reproduction

Analysis started	2020-07-19 12:15:11.322285
Analysis finished	2020-07-19 12:15:23.555514
Version	pandas-profiling v2.6.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

`Diameter` is highly correlated with `Length` and 2 other fields	High Correlation
`Length` is highly correlated with `Diameter` and 2 other fields	High Correlation
`Whole weight` is highly correlated with `Length` and 4 other fields	High Correlation
`Shucked weight` is highly correlated with `Whole weight` and 1 other fields	High Correlation
`Viscera weight` is highly correlated with `Length` and 3 other fields	High Correlation
`Shell weight` is highly correlated with `Diameter` and 2 other fields	High Correlation

Sex
Categorical

Distinct count	3
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	32.8 KiB

M	1528
I	1342
F	1307

Value	Count	Frequency (%)
M	1528	36.6%
I	1342	32.1%
F	1307	31.3%

Length

Max length	1
Mean length	1
Min length	1

Value	Count	Frequency (%)
Uppercase_Letter	3	100.0%

Value	Count	Frequency (%)
Latin	3	100.0%

Value	Count	Frequency (%)
ASCII	3	100.0%

Length
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	134
Unique (%)	3.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.5239920996
Minimum	0.075
Maximum	0.815
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	0.075
5-th percentile	0.295
Q1	0.45
median	0.545
Q3	0.615
95-th percentile	0.69
Maximum	0.815
Range	0.74
Interquartile range (IQR)	0.165

Descriptive statistics

Standard deviation	0.1200929126
Coefficient of variation (CV)	0.2291884031
Kurtosis	0.06462097389
Mean	0.5239920996
Median Absolute Deviation (MAD)	0.09667826577
Skewness	-0.639873269
Sum	2188.715
Variance	0.01442230765

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.075 0.1525 0.2325 0.2725 0.3475 ... 0.6525 0.6725 0.7275 0.7525 0.815 ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.625	94	2.3%
0.55	94	2.3%
0.575	93	2.2%
0.58	92	2.2%
0.62	87	2.1%
0.6	87	2.1%
0.5	81	1.9%
0.57	79	1.9%
0.63	78	1.9%
0.61	75	1.8%
Other values (124)	3317	79.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.075	1	< 0.1%
0.11	1	< 0.1%
0.13	2	< 0.1%
0.135	1	< 0.1%
0.14	2	< 0.1%

Value	Count	Frequency (%)
0.815	1	< 0.1%
0.8	1	< 0.1%
0.78	2	< 0.1%
0.775	2	< 0.1%
0.77	3	0.1%

Diameter
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	111
Unique (%)	2.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.4078812545
Minimum	0.055
Maximum	0.65
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	0.055
5-th percentile	0.22
Q1	0.35
median	0.425
Q3	0.48
95-th percentile	0.545
Maximum	0.65
Range	0.595
Interquartile range (IQR)	0.13

Descriptive statistics

Standard deviation	0.09923986613
Coefficient of variation (CV)	0.2433057784
Kurtosis	-0.04547558144
Mean	0.4078812545
Median Absolute Deviation (MAD)	0.08029579943
Skewness	-0.6091981423
Sum	1703.72
Variance	0.00984855103

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.055 0.0975 0.1675 0.1925 0.2475 ... 0.5275 0.5525 0.5775 0.6025 0.65 ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.45	139	3.3%
0.475	120	2.9%
0.4	111	2.7%
0.5	110	2.6%
0.47	100	2.4%
0.48	91	2.2%
0.455	90	2.2%
0.46	89	2.1%
0.44	87	2.1%
0.485	83	2.0%
Other values (101)	3157	75.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.055	1	< 0.1%
0.09	1	< 0.1%
0.095	1	< 0.1%
0.1	2	< 0.1%
0.105	4	0.1%

Value	Count	Frequency (%)
0.65	1	< 0.1%
0.63	3	0.1%
0.625	1	< 0.1%
0.62	1	< 0.1%
0.615	1	< 0.1%

Height
Real number (ℝ_≥0)

Distinct count	51
Unique (%)	1.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.1395163993
Minimum	0
Maximum	1.13
Zeros	2
Zeros (%)	< 0.1%
Memory size	32.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0.075
Q1	0.115
median	0.14
Q3	0.165
95-th percentile	0.2
Maximum	1.13
Range	1.13
Interquartile range (IQR)	0.05

Descriptive statistics

Standard deviation	0.04182705661
Coefficient of variation (CV)	0.2998002873
Kurtosis	76.02550923
Mean	0.1395163993
Median Absolute Deviation (MAD)	0.03128485168
Skewness	3.128817379
Sum	582.76
Variance	0.001749502664

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0. 0.0225 0.0475 0.0625 0.0725 ... 0.2025 0.2175 0.2325 0.245 1.13 ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.15	267	6.4%
0.14	220	5.3%
0.155	217	5.2%
0.175	211	5.1%
0.16	205	4.9%
0.125	202	4.8%
0.165	193	4.6%
0.135	189	4.5%
0.145	182	4.4%
0.13	169	4.0%
Other values (41)	2122	50.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
0.01	1	< 0.1%
0.015	2	< 0.1%
0.02	2	< 0.1%
0.025	5	0.1%

Value	Count	Frequency (%)
1.13	1	< 0.1%
0.515	1	< 0.1%
0.25	3	0.1%
0.24	4	0.1%
0.235	6	0.1%

Whole weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	2429
Unique (%)	58.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.8287421594
Minimum	0.002
Maximum	2.8255
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	0.002
5-th percentile	0.1259
Q1	0.4415
median	0.7995
Q3	1.153
95-th percentile	1.6949
Maximum	2.8255
Range	2.8235
Interquartile range (IQR)	0.7115

Descriptive statistics

Standard deviation	0.4903890182
Coefficient of variation (CV)	0.5917268871
Kurtosis	-0.02364350427
Mean	0.8287421594
Median Absolute Deviation (MAD)	0.400454117
Skewness	0.5309585633
Sum	3461.656
Variance	0.2404813892

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[2.00000e-03 1.35000e-02 1.69250e-01 1.14625e+00 1.38525e+00 1.56825e+00 1.80900e+00 2.27125e+00 2.82550e+00], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.2225	8	0.2%
0.196	7	0.2%
0.97	7	0.2%
0.4775	7	0.2%
1.1345	7	0.2%
0.6765	6	0.1%
0.18	6	0.1%
0.3245	6	0.1%
0.5805	6	0.1%
0.494	6	0.1%
Other values (2419)	4111	98.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.002	1	< 0.1%
0.008	1	< 0.1%
0.0105	1	< 0.1%
0.013	1	< 0.1%
0.014	1	< 0.1%

Value	Count	Frequency (%)
2.8255	1	< 0.1%
2.7795	1	< 0.1%
2.657	1	< 0.1%
2.555	1	< 0.1%
2.55	1	< 0.1%

Shucked weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	1515
Unique (%)	36.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.3593674886
Minimum	0.001
Maximum	1.488
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	0.001
5-th percentile	0.0524
Q1	0.186
median	0.336
Q3	0.502
95-th percentile	0.7402
Maximum	1.488
Range	1.487
Interquartile range (IQR)	0.316

Descriptive statistics

Standard deviation	0.221962949
Coefficient of variation (CV)	0.6176489417
Kurtosis	0.5951236784
Mean	0.3593674886
Median Absolute Deviation (MAD)	0.1794554199
Skewness	0.7190979218
Sum	1501.078
Variance	0.04926755074

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[1.00000e-03 3.37500e-02 5.00750e-01 6.06750e-01 6.96250e-01 7.78750e-01 9.53000e-01 1.24925e+00 1.48800e+00], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.175	11	0.3%
0.2505	10	0.2%
0.165	9	0.2%
0.096	9	0.2%
0.2025	9	0.2%
0.419	9	0.2%
0.302	9	0.2%
0.2945	9	0.2%
0.2	9	0.2%
0.21	9	0.2%
Other values (1505)	4084	97.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.001	1	< 0.1%
0.0025	1	< 0.1%
0.0045	2	< 0.1%
0.005	3	0.1%
0.0055	2	< 0.1%

Value	Count	Frequency (%)
1.488	1	< 0.1%
1.351	1	< 0.1%
1.3485	1	< 0.1%
1.253	1	< 0.1%
1.2455	1	< 0.1%

Viscera weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	880
Unique (%)	21.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.1805936079
Minimum	0.0005
Maximum	0.76
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	0.0005
5-th percentile	0.027
Q1	0.0935
median	0.171
Q3	0.253
95-th percentile	0.3796
Maximum	0.76
Range	0.7595
Interquartile range (IQR)	0.1595

Descriptive statistics

Standard deviation	0.1096142503
Coefficient of variation (CV)	0.6069663902
Kurtosis	0.084011749
Mean	0.1805936079
Median Absolute Deviation (MAD)	0.08925215223
Skewness	0.5918521514
Sum	754.3395
Variance	0.01201528386

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[5.0000e-04 4.2500e-03 3.3250e-02 2.4775e-01 3.1850e-01 3.8750e-01 4.2675e-01 5.2625e-01 7.6000e-01], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.1715	15	0.4%
0.196	14	0.3%
0.061	13	0.3%
0.037	13	0.3%
0.2195	13	0.3%
0.0575	13	0.3%
0.159	12	0.3%
0.1905	12	0.3%
0.0265	12	0.3%
0.1625	12	0.3%
Other values (870)	4048	96.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0005	2	< 0.1%
0.002	1	< 0.1%
0.0025	2	< 0.1%
0.003	3	0.1%
0.0035	3	0.1%

Value	Count	Frequency (%)
0.76	1	< 0.1%
0.6415	1	< 0.1%
0.59	1	< 0.1%
0.575	1	< 0.1%
0.5745	1	< 0.1%

Shell weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	926
Unique (%)	22.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.2388308595
Minimum	0.0015
Maximum	1.005
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	0.0015
5-th percentile	0.0384
Q1	0.13
median	0.234
Q3	0.329
95-th percentile	0.48
Maximum	1.005
Range	1.0035
Interquartile range (IQR)	0.199

Descriptive statistics

Standard deviation	0.1392026695
Coefficient of variation (CV)	0.5828504316
Kurtosis	0.5319261262
Mean	0.2388308595
Median Absolute Deviation (MAD)	0.1124146562
Skewness	0.6209268251
Sum	997.5965
Variance	0.0193773832

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.0015 0.0295 0.03025 0.03475 0.03525 ... 0.4905 0.531 0.6275 0.7255 1.005 ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0.275	43	1.0%
0.25	42	1.0%
0.265	40	1.0%
0.315	40	1.0%
0.185	40	1.0%
0.285	37	0.9%
0.17	37	0.9%
0.175	36	0.9%
0.3	36	0.9%
0.22	36	0.9%
Other values (916)	3790	90.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0015	1	< 0.1%
0.003	1	< 0.1%
0.0035	1	< 0.1%
0.004	2	< 0.1%
0.005	12	0.3%

Value	Count	Frequency (%)
1.005	1	< 0.1%
0.897	1	< 0.1%
0.885	2	< 0.1%
0.85	1	< 0.1%
0.815	1	< 0.1%

Rings
Real number (ℝ_≥0)

Distinct count	28
Unique (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	9.933684463
Minimum	1
Maximum	29
Zeros	0
Zeros (%)	0.0%
Memory size	32.8 KiB

Quantile statistics

Minimum	1
5-th percentile	6
Q1	8
median	9
Q3	11
95-th percentile	16
Maximum	29
Range	28
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	3.224169032
Coefficient of variation (CV)	0.324569302
Kurtosis	2.330687427
Mean	9.933684463
Median Absolute Deviation (MAD)	2.362462357
Skewness	1.114101898
Sum	41493
Variance	10.39526595

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[ 1. 2.5 3.5 4.5 5.5 ... 15.5 17.5 20.5 23.5 29. ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
9	689	16.5%
10	634	15.2%
8	568	13.6%
11	487	11.7%
7	391	9.4%
12	267	6.4%
6	259	6.2%
13	203	4.9%
14	126	3.0%
5	115	2.8%
Other values (18)	438	10.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	1	< 0.1%
3	15	0.4%
4	57	1.4%
5	115	2.8%

Value	Count	Frequency (%)
29	1	< 0.1%
27	2	< 0.1%
26	1	< 0.1%
25	1	< 0.1%
24	2	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Count
Matrix

First rows

	Sex	Length	Diameter	Height	Whole weight	Shucked weight	Viscera weight	Shell weight	Rings
0	M	0.455	0.365	0.095	0.5140	0.2245	0.1010	0.150	15
1	M	0.350	0.265	0.090	0.2255	0.0995	0.0485	0.070	7
2	F	0.530	0.420	0.135	0.6770	0.2565	0.1415	0.210	9
3	M	0.440	0.365	0.125	0.5160	0.2155	0.1140	0.155	10
4	I	0.330	0.255	0.080	0.2050	0.0895	0.0395	0.055	7
5	I	0.425	0.300	0.095	0.3515	0.1410	0.0775	0.120	8
6	F	0.530	0.415	0.150	0.7775	0.2370	0.1415	0.330	20
7	F	0.545	0.425	0.125	0.7680	0.2940	0.1495	0.260	16
8	M	0.475	0.370	0.125	0.5095	0.2165	0.1125	0.165	9
9	F	0.550	0.440	0.150	0.8945	0.3145	0.1510	0.320	19

Last rows

	Sex	Length	Diameter	Height	Whole weight	Shucked weight	Viscera weight	Shell weight	Rings
4167	M	0.500	0.380	0.125	0.5770	0.2690	0.1265	0.1535	9
4168	F	0.515	0.400	0.125	0.6150	0.2865	0.1230	0.1765	8
4169	M	0.520	0.385	0.165	0.7910	0.3750	0.1800	0.1815	10
4170	M	0.550	0.430	0.130	0.8395	0.3155	0.1955	0.2405	10
4171	M	0.560	0.430	0.155	0.8675	0.4000	0.1720	0.2290	8
4172	F	0.565	0.450	0.165	0.8870	0.3700	0.2390	0.2490	11
4173	M	0.590	0.440	0.135	0.9660	0.4390	0.2145	0.2605	10
4174	M	0.600	0.475	0.205	1.1760	0.5255	0.2875	0.3080	9
4175	F	0.625	0.485	0.150	1.0945	0.5310	0.2610	0.2960	10
4176	M	0.710	0.555	0.195	1.9485	0.9455	0.3765	0.4950	12

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Missing values

Sample

First rows

Last rows